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ABSTRACT 

An evaluation was conducted of a comprehensive plan 
to restructure a primary school in Candler County, Georgia, into a 
non-graded, multi-age, continuous progress learning center* The 
project entailed restructuring the classroom, implementing a shared 
decision-making structure, developing a learning curriculum, and 
using portfolio assessment to monitor student progress* The project 
was evaluated on three objectives: academic success, positive 
self-esteem and socialization, and the project's shared 
decision-making structure* These objectives were evaluated according 
to a case-study design, with the inclusion of quantitative and 
qualitative techniques. Academic success was examined through the 
following instruments: the Iowa Test of Basic Skills, portfolio 
writing, an informal reading inventory, and teacher ranking* Parent 
questionnaires, teacher questionnaires, and teacher interviews were 
used to evaluate positive self-esteem and socialization. Teacher 
interviews, teacher workshops, teacher questionnaires, and parent 
questionnaires were used to examine the shared decision-making 
structure. The evaluation found that all three objectives were being 
met by the project* Caveats included the need for administrative 
support, teacher understanding and motivation, cooperation from other 
schools and the central office staff, and community support* (VL) 
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Promoting Achievement in Child Centered Education: 
Evaluation of a Non-Graded , Multi-age, 
Continuous Progress Primary School (K-3) 

introduction 

Promoting Achievement in child Centered Education (P.A.C.E.) is 
a comprehensive plan to restructure Netter Primary School (K-3) 
(Candler county, Georgia) into a non-graded, multi-age, continuous 
progress learning center. Ketter Primary School has developed a 
continuous progress curriculum which provides the students the 
opportunity to proceed from entry at age 5 (K) continuous \y to age 8 
(grade 3) . Student progress is assessed through a portfolio which 
includes teacher observations, samples of student work, and test 
results where appropriate. The project has been developed in an 
arrangement of shared decision making between teachers and 
administrators, which the project participants believe has been 
critical in the project success. 

Supported though the Innovation Program of the State Department 
of Education of Georgia, th^ project involves extensive restructuring 
of the K-3 classrooms, a shared decision making structure f the 
development of a learning continuum , and the use of portfolio 
assessment to monitor student progress. This paper will describe the 
P.A.C.E project and the results of the evaluation required as a part 
of each innovation program in the state, 
ttha Pgo-lect 

In P.A.C.E., teachers were regrouped into three teaching teams. 
One of the teams consists of twelve regular classroom teachers 
(traditional K & 1) and two remedial program teachers. The second 
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team has the same configuration , except that the traditional teachers 
are from the second and third grades. The third teams consists of 
the special education teachers , the physical education teachers, the 
art teacher, the music teacher, and the media specialist. Team 
leaders are selected through consensus by the three teams to serve 
with the principal and the assistant principal as the building 
leadership team. The leadership team formed teacher committees to 
plan for curriculum needs, staff development needs f public relations 
needs, resources and fund raising needs. 

The major activity for curriculum and assessment vas the 
development of the learning continuum. The Metter Primary School 
learning continuum was modeled after the continuum of the British 
Columbia Ministry of Education with adaptations to include Georgia's 
Quality Core Curriculum. The continuum is used as a guide for the 
development and implementation of portfolio assessment and is used in 
parent conferences. Other major restructuring changes involve the 
classroom learning environments and the instructional delivery model. 
Classrooms are organized in learning centers which reflect thematic 
units which teachers select on a monthly basis. Thematic unit plans 
and materials are developed by the teachers. Team leaders organize 
the theme schedules. Teaching strategies used are whole language, 
cooperative learning, portfolio assessment and math manipulatives. 
Evaluation Design 

Design utilised 

The evaluation of this project followed a case study design, 
with the inclusion of quantitative and qualitative techniques for 
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data collection and analysis purposes. Yin (1989) noted that the 
case design allows for flexibility and contextual constraints. This 
design was selected for these reasons , along with the fact that use 
of a quasi -experimental design was deemed to be inappropriate and 
essentially unworkable for this project. (Comparisons across age 
groups and across project years were made whenever the data were 
available.) 

instrumentation 

A variety of data collection instruments and techniques were 
used for the P.A.C.E. evaluation. While the major consideration in 
all data collection activities was to minimize disruption and 
intrusiveness, ample data were obtained to address the project 
objectives* In the remainder of this section, the project objectives 
are listed with a description of the data collection instruments Cor 
each objective. (See Chart A for a listing of data collection and 
analysis milestones.) 

Ob j active 1, To create a nurturing environment to ensure 
p^yflpmin opportunities for academic success at the primary level. 

The core of the academic record of the P.A.C.E. project consists 
of the portfolio and the learning continuum. Items from the 
portfolio , norm-referenced test scores from the student permanent 
records, and the teacher ranking of student ability were used to 
address Objective 1. 

Iowa Tsst of Basic skills <ITBS) 

The Iowa Test of Basic Skills has been used on a regular basis 
as part of the standardized testing program in many of the school 
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systems in Georgia* The validity and reliability of the ITBS is 
well-documented and generally accepted. Because new norms were 
developed for the 1993 ITBS, extreme caution should be taken in any 
analysis using these scores, especially in comparison with scores 
based upon the previous norms. Conversion factors for comparing the 
1993 ITBS scores with previous scores were not available when this 
evaluation was completed. (The ITBS scores used for the P»A.C,E. 
project are listed on Chart B and Chart c.) 

Third grade ITBS scores were collected for Netter Primary School 
students since the 1991-1992 school year. Prior to this time, the 
ITBS was administered only to the third graders in the Chapter I 
program ♦ Thus, comparisons could be made for third graders who were 
in the program for one year and third graders who were in for two 
years, (ITBS scores are discussed in terms of grades because of how 
they are reported. ) 

Chapter I students are given the ITBS each year they receive 
service, so ITBS scores could be available for some students for 
first through fifth grades. The progress of Chapter I students in 
terms of ITBS scores is examined (Charts B and C) for Chapter I 
first, second, third and fourth grade students generally from 1989-90 
to 1992-93. 

Portfolio writing 

Writing samples from randomly selected student portfolios were 
analyzed using the Developmental Stage Scoring Guidelines of the 
Georgia Writing Assessment for Grade 3-5 (Georgia Department of 
Education, 1993), A writing sample from the fall of a student's 
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first year in the project and the spring of the student's second year 
in the project (or first year, depending on how long in the project) 
were analyzed. Alphabetical lists of students were used by the 
teachers to select every third student whose writing would be 
analyzed . 

According to Dr. David Payne, Director of the Writing Assessment 
Project, and Dr. Belita Gordon, Associate Director of the Project 
(personal communication; 1993), any paper which is scorable is 
considered to be at least at the third grade level. The inter-rater 
reliability coefficient for the analytic scoring system is ,82, and 
it is better for the developmental stages used for the P.A.C.E. 
project. The P.A.C.E. papers were scored by two raters trained by 
the Writing Assessment Project; agreement was obtained on over 98% of 
the ratings. 

Inform* 1 Reeding inventory 

An informal reading inventory (IRI) was completed by every 
fourth year student who would be moving to Metter Middle School for 
the 1993-1994 academic year. The Silvaroli IRI was used to determine 
individual student word recognition, comprehension skills, spelling 
ability, and listening capacity (contact the authors for a copy of 
the IRI) • The inventory used at Metter Primary included forms A and 
B, which are designed for grades 1-6. Teacher time spent varied from 
12-20 minutes per child. The IRI gives individual independent and 
instructional reading levels* Since it is contextually based, is 
done individually, and allows for prompts to students, it is 
different from the ITBS- Teachers at Metter Primary School contend 
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10. 

that it is a much better indicator of a student's reading ability, 
not test-taking ability. 
Teacher Ranking 

Teachers were asked to rank their current fourth year students 
in terns of academic ability in relation to the other fourth year 
students in the class. Rankings were lowest third of the class, 
middle third of the class, and highest third of the class. 

Objeotive 2. To create a nurturing learning environment to 
ensure maximum opportunities for developing positive self -esteem and 
socialization. 

Formal instrumentation for measuring self-esteem and 
socialization were not used, primarily due to the request of the 
teachers that data collection be as unobtrusive as possible. Data 
used to address this objective are from parent and teacher interviews 
and questionnaires. 

Parent Questionnaire 

A survey of parents was conducted in May 1992 and August 1993 , 
utilizing a questionnaire developed by the project staff and the 
evaluator. Questions elicited parent perceptions about student 
academic progress, multi-age and heterogeneous grouping, parent 
conferences, and student portfolios. 

Teacher Questionnaires 

In the spring of 1992 and the spring of 1993, project 
teachers completed a teacher questionnaire designed by the project 
coordinator and the evaluator. Questions elicited teacher 
perceptions of student academic and social progress, self-esteem, 
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heterogeneous and multi-age grouping, parent conferences, and 
portfolio assessment. 

Teacher Interviews 

Teachers interviews were conducted during the first year of 
the project (1991-1992). Emphasis was on teacher perception of 
multi-age and heterogeneous grouping, portfolio assessment, parent 
conferences, the pod structure, and curriculum changes. The 
questions were developed by the project coordinator, the project 
evaluator, and the principal. Interviews were conducted by the 
e valuator. 

Objective 3. To create a shared decision making structure for 
faculty, staff, administrator and students to ensure a cohesive, 
uniformed approach to the development of a nurturing learning 
environment. 

Data collected from the following instruments and described 
under Objective 2 were also used to address Objective 3: Teacher 
Interviews, Teacher Workshop, Teacher Questionnaires, and Parent 
Questionnaire . 

A variety of quantitative and qualitative techniques were used 
to collect data for the P.A.C.E. project evaluation. Results of the 
analyses for both quantitative and qualitative data are presented 
with each objective which they address. 

Objective 1. Academic Success 

Iowa Test of Basic Skills (ITBS) - I TBS scores were analyzed for 
all students and for Chapter I students. Same grade comparisons for 
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all third grade students, first through fourth grade Chapter I 
students (Chart B) , and the class histories for Chapter I students 
(Chart C) are presented below. (Because of the lack of covariates 
for determining at what point any of these groups were upon entering 
Metter Primary School, caution should exercised in interpreting the 
results of the data analysis. I TBS scores are presented for those 
adopting sites that are interested in standardized test score 
performance. Additional caution should be noted because of the 
apparent context -bound nature of the F.A.C.E, Project for which 
standardized tests — especially norm-referenced — tests may be 
inappropriate . ) 

Third grade itbs: Third grade ITBS scores in reading and math 
were compared for all students in the program for two years in 
1992-1993 and one year in 1991-1992. 

As can be seen in Table 1, there were no statistically 
significant differences between the two groups of students. The 
academic achievement of the P.A.C.E. third grades as measured by the 
ITBS remained stable over the two years of the project. (This is 
counter to some teacher and parent perceptions that the project would 
cause a drop in scores over time.) 

Chapter X Students - Same grade comparisons for ITBS . The 
results of same grade comparisons for Chapter I students are 
presented in Tables 2-5, with summaries on Tables 6-7. Students 
included in all Chapter I score sets meet state and federal 
guidelines for Chapter I eligibility. 
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Table 1 ; THIRD GRADE SCORES 
ALL STUDENTS INCLUDED 
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A COMPARISON OF FOURTH YEAR (currently 3rd oraders) , FIFTH YEAR (currently 4th 

GRADERS) AND SIXTH YEAR (CURRENTLY 5TH GRADERS) STUDENTS • 



READING (NCE) NO 


SIGNIFICANCE 




GROUP 


n 


MEAN 


SIGNIFICANCE 


FOURTH YEAR 


102 


38.40 




FIFTH YEAR 


131 


38.37 




SIXTH YEAR 


46 


36.30 




READING (NPR) NO SIGNIFICANCE 






| GROUP 


n 


MEAN 


SIGNIFICANCE 


FOURTH YEAR 


102 


34.54 




FIFTH YEAR 


131 


34.14 




SIXTH YEAR 


46 


28.63 




HATH (NCE) NO SIGNIFICANCE 


GROUP 


n 


MEAN 


SIGNIFICANCE 


FOURTH YEAR 


102 


42.40 




FIFTH YEAR 


131 


41.33 




SIXTH YEAR 


46 


37.54 




MATH (NPR) NO SIGNIFICANCE 


GROUP 


n 


MEAN 




1 FOURTH YEAR 


102 


39.15 




I! FIFTH YEAR 


131 


37.96 


SIGNIFICANCE | 


1 SIXTH YEAR 


46 


32.85 
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14. 

Key differences are listed below: 

First grade (Table 2). Current first graders who had been in 
the program for two years preformed statistically significantly 
better in reading than the first graders in P.A.C.E. for only one 
year, but not significantly better than first graders who were never 
in the project* There were no differences among the three groups in 
terms of math ITBS scores. 

Second grade (Table 3) . Second graders in 1990 and 1991 had not 
been in the project at the time that they took the ITBS, but they 
statistically significantly out-performed in reading those second 
graders who had been in the program one year (1992) or two years 
(1993). In mathematics, the same results were generally found, 
except that the 1991 second graders' scores were statistically 
significantly better than the 1993 second graders' scores. 

Third grade (Table 4). Similar to the second graders who had 
not participated in P.A.C.E. , third grade students who had not been 
in this program statistically significantly out-performed in reading 
those third grade students who had been in the program one or two 
years . 

Fourth grade (Table 5) . The fourth grade Chapter 1 comparisons 
are similar to those for the first grade. Reading scores for 1993 
fourth graders who had been in the program one year were slightly 
better than the reading scores for the 1992 fourth graders who had 
not been in the program at all. The 1993 fourth graders did 
statistically significantly better than the 1992 fourth graders who 
had not been in P.A.C.E. 

1 53 
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Table 2 i 1ST GRADE SCORES 
CHAPTER SCORES ONLY 
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A COMPARISON OF SECOND YEAR (currently ist oradeju) , THIRD YEAR (currently 2nd 
graders), AND FOURTH YEAR (CURRENTLY SRD graders) STUDENTS USING A ONEWAY 
ANALYSIS OF VARIANCE AND A MODLSD RANGE TEST. 



READING (NCE) P< .04 



GROUP 


YEAR 


n 


MEAN 


SIGNIFICANCE 


SECOND YEAR 


1993 


4B 


33.56 


2>3 


I! THIRD YEAR 


1992 


46 


2B.04 




| FOURTH YEAR 


1991 


65 


31.94 





READING (NPR) P< .04 



.'GROUP 


; %BAR. ' 


n 


' .V'MEAN? ' 


I SIGNIFICANCE 


SECOND YEAR 


1993 


4B 


25.17 


2>3 


THIRD YEAR 


1992 


46 


IB. 87 




FOURTH YEAR 


1991 


65 


21.40 





MATH (NCE) NO SIGNIFICANC] 


E 


GROUP * 


•'•YEAR 


>'••• • n 


MEAN 


SIGNIFICANCE 


SECOND YEAR 


1993 


48 


28.77 




THIRD YEAR 


1992 


46 


26.41 




1 FOURTH YEAR 


1991 


63 


26.40 





MATH (NPR) NO SIGNIFICANCE 



GROUP 


""'YEAR 


n 


MEAN 


SIGNIFICANCE 


SECOND YEAR 


1993 


48 


20.9B 




THIRD YEAR 


1992 


46 


21.13 




FOURTH YEAR 


1991 


64 


17.84 
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Table 3 : 2ND GRADE SCORES 
CHAPTER SCORES ONLY 
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A COMPARISON OF THIRD YEAR (currently 2nd graders , FOURTH YEAR (currently jrd 
orapers), FIFTH YEAR (currently *th drapers) , AND SIX YEAR (currently sth graders) 
STUDENTS USING A ONEWAY ANALYSIS OF VARIANCE AND A MODLSD RANGE 
TEST. 



REAPING (NCE) P< .001 



1 '•.•fcROUp 


:: ''¥BAR 


n 


*= "HEANf . li» 


SIGNIFICANCE 


1 THIRD YEAR 


1993 


59 


22. 6B 




1 FOURTH YEAR 


1992 


6B 


20.96 




FIFTH YEAR 


1991 


44 


33.41 


5>4,3 


SIXTH YEAR 


1990 


32 


35.16 


6>4,3 



ItEADlNG (NPR) P< .001 





. YEAR 


n 


MEAN 


SIGNIFICANCE 


THIRD YEAR 


1993 


99 


14.63 




FOURTH YEAR 


1992 


68 


12.09 




FIFTH YEAR 


1991 


44 


23. 9B 


5>4,3 


| SIXTH YEAR 


1990 


32 


27.25 


6>4,3 



MATH (NCE) P< .01 



| ■ GROUP 


V' YEAR 1 ■< 


n 


MEAN 


SIGNIFICANCE 


THIRD YEAR 


1993 


5B 


35.48 




FOURTH YEAR 


1992 


6B 


37.54 




FIFTH YEAR 


1991 


45 


45.67 


T 1 


| SIXTH YEAR 


1990 


32 


45 





MATH (NPR) P< .02 (wo two oroups are sign, different at the .05 lbvhd 



GROUP 


: "YEAR'' 


n ,'■ 


■• •'mean : ' 


"significance 


THIRD YEAR 


1993 


58 


30.91 




FOURTH YEAR 


1992 


68 


33.13 




FIFTH YEAR 


1991 


45 


44.24 




SIXTH YEAR 


1990 


32 


43.66 
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T«bl« 4 i THIRD ORAOB SCORES 
CHAPTER SCORES ONLY 
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A COMPARISON OF FOURTH YEAR (cumiently j*d okadev) , FIFTH YEAR (currently «th 
graders) AND SIXTH YEAR (currently sth graders) STUDENTS USING A ONEWAY 
ANALYSIS OF VARIANCE AND A MODLSD RANGE TEST. 



READING (NCE) P< .005 



'' l^GROUE^^ 


..i„YEAR 


h 


^EANf:i|i 


INSIGNIFICANCE I 


FOURTH YEAR 


1993 


27 


22.81 




FIFTH YEAR 


1992 


47 


26.12 




SIXTH YEAR 


1991 


30 


33.5 V 


6>4,5 


READING (NPR) P£ .01 






GROUP 


YEAR 


n 


MEAN 


SIGNIFICANCE 


FOURTH YEAR 


1993 


27 


12.67 




FIFTH YEAR 


1992 


47 


17.77 




SIXTH YEAR 


1991 


30 


24.60 


6>4 


MATH (NCE) NO £ 


ilGNIFICAN 


c: 


E 






• • ^iGROUP:"*^ 


• "YEAR 


ri '**>. 




? ••• SIGNIFICANCE' " - 


FOURTH YEAR 


1993 


27 


27.19 




FIFTH YEAR 


1992 


46 


31.37 




SIXTH YEAR 


1991 


31 


36.19 




MATH (NPR) NO i 


SIGNIFICANCE 












1 n 


: i""' >: " HEANi. ; '-:^ 




FOURTH YEAR 


1993 


27 


18.22 


SIGNIFICANCE | 


FIFTH YEAR 


1992 


46 


25.26 




SIXTH YEAR 


1991 


31 


30.03 
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Table 5 ; FOURTH GRADE SCORES 
CHAPTER SCORES ONLY 



IB. 



A COMPARISON OF FIFTH (currently ath graders) AND SIXTH YEAR (currently ath 
graders) STUDENTS USING A ONEWAY ANALYSIS OF VARIANCE AND A MODLSD 
RANGE TEST* 



READING (NCE) NO SIGNIFICANCE 



! GROUP 


" : =YBliR"'"' 


n 


MEAN 


SIGNIFICANCE 


FIFTH YEAR 


1993 


61 


32.93 




SIXTH YEAR 


1992 


46 


31.74 




READING (NPR) 


NO SIGNIFICANCE 


| :: 6RODP' :i ' 






MEAN 


SIGNIFICANCE j 


FIFTH YEAR 


1993 


61 


24.44 




SIXTH YEAR 


1992 


46 


23.26 




MATH (NCE) P< .05 


GROUP 


; ' ^EaV1 ! 




• MEAN 


SIGNIFICANCE 


FIFTH YEAR 


1993 


63 


33. B2 


5>6 


SIXTH YEAR 


1992 


46 


2B.20 




MATH (NPR) P < 


: .03 






GROUP 


' : - YEAR' 


: ■ 


MEAN 


SIGNIFICANCE 


FIFTH YEAR 


1993 


63 


26.97 


5>6 


SIXTH YEAR 


1992 


46 


18.93 
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Chanter T itnflaat Z QlMMM hialaeiM (Tables 8-11) . Studsnts 
included in a class history data set must have a score (i.e., must 
have been in Chapter I) each ysar in order to remain in the class 
(i.e., the data set), thus accounting for the small numbar of 
subjects for each class history as compared to tha sama grade Chapter 
I comparisons above. 

The only longitudinal view of progrsss of a class was obtained 
for the Chapter I studsnts (Chart C) • Similar to tha rssults for the 
Chapter I same grade comparisons, ths rssults do not fit a clear 
pattern. Interpretations of thsse data are extremely difficult, 
especially because of the small number of oases for some classes and 
the change in norms for the 1992-1993 test year. What is intsresting 
to note with this set of data is that statistically significantly 
lower scores in reading were obtained for those years that the 
students had been in the program when compared to previous years when 
they had not. For example , first year studsnts' ssoond grade ITBS 
reading scores (one year in P.A.C.E.) were statistically 
significantly lower than their first grads scores (non-projsct ysar). 
(This could be interpreted as an invalid application of tha ITBS 
b tuauss of the aontext-based curriculum and the academic dsficisnciss 
of ths studsnts.) 

ITBS summary . ITBS scores should be interpreted with sxtrsms 
caution for a wide variety of reasons , as mentioned above. The ITBS 
results foi third graders who leave Metter Primary after one or two 
years in ths program are compelling evidence that student progress 
has not been negatively affeuted by the changes at the school. 
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Tabla i t FOURTH YEAR STUDENTS 
CHAPTER ONLY 



23. 



PAIRED T-TEST (1 


ST, 2ND, 3RD GRADE SCORI 


BS) 


I GRADE 


SUBJECT 


n 


MEAN 1 


1ST 


READING (NCE) 


18 


33.67 1 


2ND 


READING (NCE) 


18 


17.16 | 


3RD 


READING (NCE) 


18 


23.67 


1ST 


READING (NPR) 


18 


23.44 


2ND 


READING (NPR) 


18 


7.33 


1 3RD 


READING (NPR) 


18 


13.06 





SIGNIFICANCE OF (NCE) - P< .001 1>2, P< .003 1>3, NONE - 2,3 
SIGNIFICANCE OF (NPR) - P< .001 1>2, P< .004 1>3, P< .04 3>2, 



FAIRED T-TEST (1ST, 2ND, 3RD GRADE SCORES) 



GRADE 


SUBJECT 


n 


MEAN 


1ST 


HATH (NCE) 


18 


25.89 


2ND 


HATH (NCE) 


18 


33.17 


3RD 


HATH (NCE) 


18 


25.00 


1ST 


HATH (NPR) 


IB 


15.56 


2ND 


MATH (NPR) 


18 


27.83 


1 3RD 


MATH (NPR) 


18 


16.33 _J 



NO SIGNIFICANT DIFFERENCE FOR (NCE) 
SIGNIFICANT DIFFERENCE FOR (NPR) P< .025 2>1 
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gable lO a FIFTH YEAR STUDENTS 
CHAPTER ONLY 
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PAIRED T-TEST (2 


ND, 3RD, 4TH GRADE SCOR 


ES) 


GRADE 


SUBJECT 


n 


MEAN I 


2ND 


READING (NCE) 


43 


33.79 


3RD 


READING (NCE) 


43 


26.84 


4TH 


READING (NCE) 


43 


33.74 


2ND 


READING (NPR) 


43 


24.39 


3RD 


READING (NPR) 


43 


18.40 


4TH 


READING (NPR) 


43 


25.49 



SIGNIFICANCE OF (NCE) - P< .003 2>3, NONE - 2,4, P< .003 4>3 
SIGNIFICANCE OF (NPR) = P< .029 2>3, NONE - 2,*, P< .004 4>3 



PAIRED T-TEST (2 


ND, 3RD, 4TH GRADE SCO] 


RES) 


GRADE 


SUBJECT 


n 


MEAN 


2ND 


HATH (NCE) 


44 


44.98 


3RD 


HATH (NCE) 


44 


33.45 


4TH 


HATH (NCE) 


44 


33.55 


2ND 


HATH (NPR) 


44 


43.23 


3RD 


HATH (NPR) 


44 


26.30 


1 4TH 


HATH (NPR) 


44 


26.91 



SIGNIFICANCE OF (NCE) - P< .001 2>3, P< .001 2>4, NONE - 3,4 
SIGNIFICANCE OF (NPR) - P< .001 2>3, P< .002 2>4, NONE" 3,4 
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Table 11 8 SIXTH YEAR STUDENTS 
CHAPTER ONLY 



25 



PAIRED T-TEST (2 


ND, 3RD, 4TH, 5TH GRADE 


SCORES) 


GRADE 


SUBJECT 


n 


MEAN | 


2ND 


READING (NCE) 


22 


32.86 . | 


3RD 


READING (NCE) 


22 


32.55 | 


4TH 


READING (NCE) 


22 


31.50 | 


5TH 


READING (NCE) 


22 


32.95 | 


2ND 


READING (NPR) 


22 


23.27 


3RD 


READING (NPR) 


22 


22.31 


4TH 


READING (NPR) 


22 


22.41 


5TH 


READING (NPR) 


22 


24.23 



SIGNIFICANCE OF (NCE) - NO GROUPS ARE SIGNIFICANTLY DIFFERENT 
SIGNIFICANCE OF (NPR) - NO GROUPS ARE SIGNIFICANTLY DIFFERENT 



PAIRED T-TEST (2ND, 3RD, 4TH, 5TH GRAD: 


E SCORES) 


GRADE 


SUBJECT 


n 


MEAN | 


2ND 


MATH (NCE) 


24 


46.58 | 


3RD 


MATH (NCE) 


24 


37.96 I 


4TH 


MATH (NCE) 


24 


30.29 I 


1 5TH 


MATH (NCE) 


24 


29.71 


2ND 


MATH (NPR) 


24 


45.79 


3RD 


MATH (NPR) 


24 


32.38 


4TH 


MATH (NPR) 


24 


21.71 


5TH 


MATH (NPR) 


24 


19.71 



SB3fflEK»ia: <F (KS) - P< .021 Z>3, P< .001 2>4, V< .001 2>5, P< .014 £>4, P< .007 3>5 
SSaOEmVO: CF (MR) =■ P< .019 2>3, P< .OOl 2>4, P< .001 2>5, P< .003 3>4, P< .007 3>5 
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Informal Reading Inventory end Teaching Ranking 

During the 1992-1993 project year, P.A.C.E. teachers had their 
students complete an informal reading inventory. The teachers also 
estimated academic ranking of their students in relation to the other 
members of their class. The reading inventory (IRI) scores, teacher 
rankings, ITBS scores for all fourth year (third grade) students were 
correlated to determine the strength of the relationships between 
these standardized and nonstandard! zed indicators of student 
performance. 

The IRI was statistically significantly correlated (p < ,05) 
with the ITBS reading and math scores; the correlations ranged from 
•22 - .33. Teacher rankings were also statistically significantly 
correlated (p < .05) with these scores, with correlations ranging 
from .43 - .50. Finally, the teacher ranking and the IRI were 
statistically significantly correlated (r = .25; p < .05). 

These results reflect a congruence among teacher assessment of 
student ability, informal reading assessment, and standardized test 
scores. While these correlations are not particularly strong, they 
do support the argument that the P.A.C.E. teachers have a clear 
assessment of their students' academic abilities. The phrase "kid 
watcher, 19 which the teachers are quite found of using to describe 
themselves, appears to be accurate. 

Portfolio Writing Assessment 

Randomly selected writing samples from student portfolios were 
analyzed using the Developmental Stage Scoring Guidelines of the 
Georgia Writing Assessment for Grades 3-5. Scores for readable 

33 
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samples range from 1 to 6 (see Appendix A) . Although the scale is 
intended for grades 3-5 and is currently in the pilot phase, it was 
used to provide another indication of the academic progress of the 
P.A.c.E. students. There were 65 pairs of samples (pre/post) taken 
for students over a two year period of the project and 35 pairs of 
writing samples taken for students over a one year of the project. 
As shown in Table 12, 83% of students with samples over a two year 
period gained at least one developmental stage on the Writing 
Assessment Scale. Almost 70% of the students with samples over a one 
year period gained at least one developmental stage. What is 
important to note is that no student in this sample had an unscorable 
paper for the second writing sample. 

In addition to these paired samples, 305 writing samples (from 
all ages of students) from the Spring of 1993 were scored. Of these 
305 samples, over 55% of the K-l samples and over 90% of the 2-3 
samples were scored as a level 2 (focused writer) or above for the 
third grade scoring guide. (Although there is no clear comparative 
base for these scores, and even though there are no grade level 
conversions for each scale indicator, the fact that almost all 305 
papers were scored in terms of a grades 3-5 scale should be viewed 
positively. ) 

Parent Questionnaire 

Because student progress was monitored and reported in a format 
that was new to the parents of Hetter Primary School students, it was 
important to determine parent reaction to this portfolio assessment 
and parent conferences. In 1992, 215 out of 474 (45.4%) of the 
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Table 12 1 portfolio Writing Assessment 



28, 



Pre/Post Assessments; 
Number of 
Paired Samples 

N = 65 



Tine 

2 years 



N 



35 



1 Year 



1993 Writing Assessments Qg305j 

Category Score 

Cannot Be Scored 8 
Copied/Not original 9 

Emerging 1 

Developing 2 



Focusing 



Experimenting 



Engaging 



Extending 



Points 
Gained 

-1 
0 
1 
2 
3 

0 
1 
2 
3 



Frequency 



1 
10 
31 
19 

4 

11 
18 
1 
5 



State: 
K-l 
2-3 1 

State t 
K-l 
2-3 1 

State i 
K-l 
2-3 1 

State: 
K-l 
2-3 1 

State: 

K-l 

2-3: 

State: 

K-l 

2-3: 

State: 

K-l 

2-3: 



Unreported 

6 (13%) 
1 (0.4%) 

3.0% 

13 (28.2%) 
24 (9.3%) 

30.8 

24 (52.2%) 
157 (60.6%) 

41.8% 
3 (4.3%) 
69 (26.6%) 

17% 
0 

7 (2.7%) 

5.8% 
0 

1 (0.4%) 

1.5% 

0 

0 



35 



BEST COPY AVAILABLE 



29. 

questionnaires were returned. In 1993, 310 out of 483 (64.2%) of the 
questionnaires were returned. 

As can be seen in Table 13, over 99% of the parents in 1992 and 
96% in 1993 stated that the conferences were set up at a time best 
suited to their needs and that they were well informed by the 
teachers. Of the 230 comments written in 1992 about the parent 
conferences and the 1B6 comments written about the portfolios, 88.7% 
of the comments on parent conferences and 94.6% of the comments about 
the portfolios were related to what parents liked best about these 
two items. For both years, parents liked the individual contact and 
extra time with teachers, the teacher's attitude and professionalism, 
and the opportunity to discuss their child's strengths and 
weaknesses. The parents liked the fact that the portfolio provided 
them a clear picture of their child's progress and they saw the 
portfolios as well organized, thorough, and more informative than a 
report card. 

The few negative comments about the parent conference (11.3% in 
1992; 16.5% in 1993) and the portfolios (5.4% in 1992; 1^.9% in 1993) 
reflected a preference for report cards and grades, the inconvenience 
of the conference, or (though not necessarily negative) the need for 
more conference time or greater explanation of the portfolio or more 
materials in the portfolio. 

summary of objective i 

The use of standardized test scores can create problems with 
interpretation, especially at lower grade/ levels and when used in a 
program which emphasizes contextual ly-based curriculum and 
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Table 13 1 Conferences and Portfolio Responses 
Parent Survey - May 1992/August 1993 



Parent Conferences and Portfolios tMM Ho 



Conference set up for a time that was best for you 

1992 (n=212) 99.1% 0.9% 

1993 (n=305) 96.7% 3.3% 
Teacher answered all the questions completely 

1992 (n=211) 100% 

1993 (n=306) 98.7% 1.3% 

Teacher explained the contents of the portfolio 

1992 (n=210) 99.1% 0.9% 

1993 (n-303) 99.0% 1.0% 
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assessment. Despite these problems , the results of the third grade 
ITBS and writing assessments strongly support the conclusion that 
Objective 1 is being met. Teacher rankings , the informal reading 
inventory, and parent comments further support this conclusion. 

Ob j active 2. Self-esteem and socialisation 

Parent Questionnaire 

Pour items on the Hay 1992 and August 1993 parent questionnaires 
elicited parent opinions about the impact of P.A.CE. of their 
child's progress in and enjoyment of school. In Table 14, the 
summary of the frequency of responses and number of comments for each 
question is presented. 

For both years , a majority of the parents responded that being 
in the same room with younger or older children had a positive effect 
on their child. Approximately one-fourth of the parents reviewed the 
impact as non-existent , while less than 7% believed it to be 
negative . 

The comments supplied by parents in support of their answers to 
the question more dramatically reflect parent support of their 
child's being in a classroom with younger or older children. For 
both years , over 85% of the comments written in response to this 
question were listed under the positive or no negative effects. Host 
of the positive comments were related to: 

** the growth and maturation of the student ("My child always 
was introverted around grown-ups , but since she has been 
to school with other children older, than herself, she 
has opened up more. She talks more than she used to,"), 
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Table 14 : Classroom Effects, Enjoyment, and Learning 
Parent Survey - Hay 1992 /August 1993 



In the same room with 
younger or older children 

1992 (n»215) 

1993 (n-301) 

in the same room with 

students stronger or 

not as strong academically 

1992 (n-207) 

1993 <n«293) 

In comparison with last year: 

Hy child has 

enjoyed school this year 

1992 (n«170) 

1993 (n-251) 

My child has learned 

1992 <n«174) 

1993 (n=240) 



Positive ho Negative 

Effect Effect Effect 

69.3% 24.2% 6.5% 

67.4% 24.6% 6.6% 

68.1% 25.6% 6.3% 

60.1% 33.4% 6.5% 

Better Same Less 

67.6% 23.5% 8.8% 

49.4% 41.4% 9.2% 

More Same Less 

79.9% 15.5% 4.6% 

59.6% 35.0% 5.4% 



3U 



BEST COPY AVAILABLE 




33. 

**better relationships with older and younger students ("one 
was learning from older children, one was helping younger 
children* ") , 

♦♦improved self-confidence ("She came home and said, 'I know 
how to read, you don't even have to tell me the wordsl M ), 

and 

**the opportunity to share learning and knowledge with other 

children ( M children learn from each other"; "liked coming 
home telling me who she helped out today.") . 
The few negative comments for this item were in the same area, but in 
the opposite direction. For example, age differences were seen as a 
disruptive factor both academically and socially ("As a parent, I 
fear that the higher level children may not be challenged enough with 
this program and that too much of their time might be spent 'helping' 
or peer teaching their lower academic level classmates."). 

The responses to the question about the impact on students being 
in the same room with students who were academically stronger or not 
as strong had generally the same pattern as for the question about 
age impact. Over 90% of the respondents for both years answered that 
this arrangement had a positive or no negative effect on their child. 
Only a little over 6% rated it as negative. 

Parent comments for both years on this question were also 
similar in distribution as the previous question. Almost 90% of the 
comments related to this item were positive or indicated no negative 
effects. Many of the comments focused on: 

** improved language and communication skills ("program has 

10 



9 

ERIC 



BEST COPY AVAILABLE 



34. 

allowed my child to develop academically aa needed. She' a 
dona wall with the program academically and has excelled 
in learn ing aa a reault of the program and other 
factors.") , 
"improved self-esteem, 

**ths bsnefits of working with different academic abilities, 
and 

** studsnt motivation to learn. 

The few negative comments for this item reflected parents review 
that P.A.C.E. classrooms had a negative effects on self-esteem and 
placed too much focus on weaker, students ("I think in my child's case 
it may have had a slight negative effect because my child is a very 
slow reader and some younger children may read better than my 
child.") . 

The vaet majority of parents in 1992 believed that their child 
enjoyed the first year in the P.A.C.E. program better than (67.6%) or 
the aame aa (21.0%) the previous year when the program had not been 
implemented. This reeponee pattern waa not aa atrong in 1993, 
poaaibly reflecting the fact that the program haa bacome more 
familiar to the etudente and the parenta, poaaibly reflecting a mild 
Hawthorne effect. Aa with the previoua itame, comntante for thia item 
were overwhelmingly positive. Parenta atatad that their child! 
*+ enjoyed school and the teacher ("She has stepped into a 
whole new environment. She loves it... she has 
blossomed. 11 ) , 
learned more, and 

11 
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**were in a less oompstitivs snvironment with 

**di verse classmatas* 
School adjustment problem* and ohild boredom with school vara 
generally typical of the extremely few negative comments* 

In a pattern reflecting the responses to othsr items in ths 
parent questionnaire in 1992 , almost 80% of the parents believed that 
their child had learned more during the first year of P*A.C*E* than 
during the previous academic year* While 15*5% felt that their child 
had learned the same as the previous year, only 4*6% of the 
respondents felt that their child had learned less than in the 
previous year. For 1993 and as with the previous item, a smaller 
percentage of positive responses was found* Almost all of the 
comments written with this item were positive; there was only one 
negative comment for this item ("the P*A*C.E* of leaning elowed 
down")* The positive comments reflected parent beliefs that: 

**their ohild was more knowledgeable, 

** there were more activities for the students ("more material in 

the ourriculum") , 
**tsachsrs vsrs mors attentive, and 

**ths ohild' s maturity level improved ("my ohild is more 
mature 91 ) • 

Tsaahsr Interviews end Questionnaire 

Teaoher reepnneee In the interview and questionnaires completed 
over the two years of the project were generally consistent. The 
vast majority of tsauhsrs rssponsss sddrssssd ths positivs impaot 
that P*A*C*E. had on ths studsnts of Msttsr Primary Sohool (sss Tabls 
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15 for an overview of the 1993 comments) • Students wars Man as 
being more aelf-conf ident , more independent, and more motivated as a 
reeult of P*A*C*E. The teachers viewed the risk-free environment 
which they have created as benefiting both academic and social 
skills. The teachers believe that the students enjoyed school more 
as a result of P.A.C*E*» 

The comments about the negative impacts of P*A*C*E. on students 
were related primarily to academic progress and discipline* One 
teacher commented that the needs of smarter children were not beirg 
met and that test scores were being negatively affected* Another 
teacher cited reduced discipline as a concern ("They show less 
self -discipline and responsibility 11 ) . 

Summary of Objective 2 

It is evident from the parent and teacher responses that 
Objective 2 has been met* The overwhelming majority of parents and 
teachers responding through questionnaires and interviews believe 
that the student self-esteem, self-confidence, and socialization have 
been enhanced during the two years of the project* 

Objective 3. shared-Decision Making 

As evident in the project description, shared decision making is 
a Cornerstone of P*A*C*E** This is also reflected in the teacher 
responses in the interviews and surveys conducted over the two years 
of the project* The positive aspects most often cited by teachers 
were: 

** opportunities to share ideas ("I feel comfortable trying 

out new ideas and varied ways of managing my classroom* 
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Table 15 . 1 Teacher Comments - 1993 Questionnaire 37* 

POSITIVE - STUB frequence 

inor eased eel f -sat earn & confidence 7 

enjoy eohool & learning 8 

eelf-motivated 4 

improved ekille academically and socially 6 

etudente learn from each other 13 

more one on one instruction 5 

more autonomy 8 

leee behavior problems 2 

NEGATIVE - CHILD FREQUENCY 

none 4 

interrupt ione (field tripe) 2 

need better lietening ekille 1 

not enough time 5 

ohildren need phyeioal epace to call their own 1 

need more etruoture for eome ohildren 5 

meeting all neede for wide range of ability levels 6 

middle ability etudente being e lighted 2 

etudente ehow leee eelf-dieoipline and responsibility 1 

test ecoree lover 1 

need better themes 1 

POSITIVE - TEACHER FREQUENCY 

enjoy program 4 

better parent-echool relationehip 2 

attending conferenoee 9 

improved morale l 

improved self-esteem 6 confidence 3 

more autonomy 4 

increased student skills 3 

personal growth as a teacher 6 

having student for two years 6 

everyone contributes 2 

multi-age grouping 2 

able to buy new things 1 

hands-on learning l 

NEGATIVE - TEACHER FREQUENCY 

not enough time for planning 10 

not enough time to aooomplieh things 8 

communication problems (teams, etc*) 2 

eome exolueion from pod eye tern 1 

more oonf erenoe time with parents & teachers (CART) 1 

teaohing a unit for a month 1 

red tape 1 

wide range of abilitiee 6 

progreee reports for parent oonferencee 1 



if 
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IMPROVING PROBLEMS FREQUENCY 

time mgmt. for students & teachers 2 

less interruptions (better planning of trips) 2 

guided discovery approach stressed more 1 

more planning time 7 

more structured classrooms for special students 1 

reading recovery teacher 1 

computer labs 1 

narrower ability grouping 2 

planning for middle students 1 

see answer #13 continuous progress 1 

closer look at scheduling 1 

better student placement 1 

remain in cub team until ready for tiger team 3 

have pre-K 1 

sec-up quieter area in classroom 1 

see #25 non-seasonal topics for all 1 



EFFECT OF PARENT INVOLVEMENT FREQUENCY 

very positive 6 

better communication 2 

enthusiastic 2 

more awareness of students progress 5 

enhanced student learning 4 

parents like conferences 3 

become more a part of child's education 6 

little parent involvement 3 

ENHANCING PARENT INVOLVEMENT FREQUENCY 

volunteer program 5 

emphasize importance of parent involvement 4 

have third time a day in the classroom 3 

loan education materials to parents 1 

home visits 1 

more active p.T*A. 1 

serve as resource person 1 



create an environment where parents feel welcome 
keep them informed 
have more say in child's education 

programs for parents where the children are involved 
covered dish and discussion time 
workshop for parents 
parent night 
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DECISION MAK™fi PROCESS 



FREQUENCY 



more a part of the school 

more comfortable with old method 

more teacher involvement 

more faculty input 

has not changed 

more consensus by whole staff 

make better decisions 



1 
1 
10 

2 
9 
2 
1 



HAS PROJECT CHANGED ATTITUDE TOWARD EDUCATION OF PRIMARY STUDENTS 



education is exciting 

confirmed attitude that children can be responsible for learning 
affirm belief in child-centered developmental ly appropriate 
curriculum 

letting students learn at their own pace 

rewarding having students for two years 

children need special attention 

need a variety of teaching methods 

learn from each other 

this project is the best way to teach 

grading is unimportant compared to interest and effort of children 



Yes - 19 



No « 10 



HOW ? 
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**Having the opportunity to participate in helping fellow 
teachers make presentations has helped me to see the 
impact of the program on the students* My self-esteem 
has improved as a result of this." , 
^★opportunities for professional growth ("Prof essionally, this 
has continued to be very challenging and I feel I have 
grown because of my exposure to professional readings, 
conferences, and my fellow teachers. w ) y and 
**the freedom to innovate and make decision*. ("The freedom to 
choose what goes on in my room. My self-confidence is 
greater. I enjoy teaching in this atmosphere. ■ ) • 
Several comments reflected a renewed sense oj enthusiasm and 
enjoyment as a teacher. 

The negative aspects of the P.A.C.E. project in terms of shared 
decision making were very few indeed. As cited in the first year 
evaluations, many of the concerns voiced by teacher.; about P.A.C.E. 
were centered around the range of ages and academic abilities in 
multi-age, heterogeneously grouped classrooms. These concerns 
persisted over the two years of the project, but were voiced by less 
than five teachers. Concern was also voiced by one teacher that 
shared decision making was a convenient way of fooling teachers into 
believing that they actually had some control over their professional 
lives. 

The most frequent comments about negative aspects of P.A.C.E. 
were related to timn. There seemed to be a consistent concern about 
the inordinate amount of time that the shared decision making process 
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took, especially when it is implemented with other innovations such 
as whole language instruction, thematic units, continuous progress 
and portfolio assessment. Add to this the tremendous number of 
interruptions due to the large number of visitors, and teachers have 
just cause for believing that time is a resource more precious than 
gold. (The problem of interruptions is reflected in the fact that 
for four months in the 1992-1993 school year, an average of. 45 
visitors a month completed the visitor questionnaire. While it is 
clear that there are quite a few educations in Georgia (and 
elsewhere) who see the P.A.C.E. project as important enough to visit, 
this "fame" has its obvious down side.) 
Summary of Objective 3 

Program descriptions, project materials, and teacher and parent 
data show that the shared-decision making process is in place at 
Primary School. Problems with time constraints are quite clear, but 
the vast majority of the teachers support the attempt at shared 
decision making. More importantly, they believe that shared decision 
making is working. 
Caveats 

The success of the P.A.C.E project in attaining the project 
objectives has not come easily. Project teachers, administrators, 
evaluators, and parents, as well as numerous visitors, have observed 
a variety of issues which must be confronted in the implementation of 
a project such as P.A.C.E. 

In conversations with visitors from other schools, there appears 
to be a general sense of lack of administrative support necessary to 
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implement a project such as P.A.C.E. The staff of Metter Primary 
School have noted that this could be overcome by having the 
administrators immerse themselves in the professional literature and 
activities (e.g., conferences, workshops) related to the various 
components of the project. 

Similarly, concern emerged about the lack of teacher 
understanding and motivation to become involved in such a program. 
Teacher professional development in the same areas as the 
administrators can go a long way in addressing these issues. While 
understanding and motivation are clearly similar issues , they seem at 
times to be inextricably intertwined in a school improvement project 
such as P.A.C.E. 

The Metter Primary School staff determined from their 
conversations with visitors and from their visits to other schools 
that there can be difficulties in trying to a implement continuous 
progress program in one elementary school in a district that has 
several elementary schools. Resistance is anticipated from the other 
elementary schools (not to mention the articulation considerations 
with the receiving schools) , as well as the central office staff. 
Serious attempts at professional collaboration and development seem 
to hold the key to reducing these problems. 

Community support at the outset of a departure from "business as 
usual" is also critical. A variety of community and special interest 
group meetings proved to be grite helpful in the Metter Primary 
School staff's efforts to have the parents and the community embrace 
the project. In addition, extensive scripting and rehearsing in 
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order to ensure that school personnel were providing consistent 
answers and a coherent approach to the community proved to be a 
superior technique for winning support* 

Any school wanting to adopt Project P.A.c.E or any other 
sweeping change must realize that it is a major restructuring 
venture. Countless hours must be spent in planning and staff 
development prior to project implementation. Upon implementation, 
the time commitment remains extremely demanding, but the focus shifts 
to continuous curriculum development and tireless "kid watching 11 in 
order to ensure that individual student needs are met. As clearly 
understated by a Metter Primary staff member, "Staff readiness, 
strong leadership, and a climate for change are key ingredients for 
the success of a multiage continuous progress program such as 
P.A.C.E." 
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Developmental Stage/Scoring Guidelines 
Georgia Writing Assessment for Gradee 3 and 6 
198243 Statewide Held Test 

Stage 1 : The Emerging Writer 

e Little or no topic development, organization, and/or detail, 
e Uttle awareness of audience or writing task. 

e Errors in surface features prevent the reader from understanding the writer's message. 
Stage 2: The Developing Writer 

e Topic beginning to be developed. Response contains the beginning of an organizational plan. 

e Limited awareness of audience and/or task. 

e Simple word choice and sentence patterns. 

e Errors in surface features interfere with communication. 

Stags 3: The Focusing Writer 

e Topic clear even though development is incomplete. Plan apparent although ideas are loosely 

organized 
e Sense of audience and/or task, 
e Minimal variety of vocabulary and sentence patterns, 
e Errors in surface features interrupt the flow of communication. 

Stage 4: The Experimenting Writer 

e Topic clear and developed: development may be uneven. Clear plan with beginning, middle, 

and end. Beginning and/or ending may be clumsy, 
e Written for an audience. 

e Experiments with language and sentence patterns. Word combinations and word choice may 
be novel. 

e Errors in surface features may interrupt the flow of communication. 
Stage 5: The Engaging Writer 

e Topic well developed. Clear beginning, middle, and end Organization sustains the writer's 

purpose, 
e Engages the reader, 

e Effective use of varied language and sentence patterns, 
e Errors in surface features do not interfere with meaning. 

Stage 8: The Extending Writer 

e Topic fully elaborated with rich details. Organization sustains writer's purpose and moves the 

reader through the piece, 
e Engages and sustains the reader's interest. 

e Creative and novel use of language and effective use of varied sentence patterns, 
e Errors in surface features do not Interfere with meaning. 

Nonscorabie Responses: 

7 Blank 

8 Illustrations only; no text, no letters 

9 Not original text; copied from board, printed material, or another writer; slotted writing 

10 Not related to assigned writing tasks 

11 Illegible o{ 

12 Written in language other than English 

From $ Georgia Dapartmant nt Educt ion. (1993), Gradai thraa and fiva writing 
ft at awmant and inatrugtional auidn. Appendix paga 8. Atlanta, OA. 
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